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SYSTEMS AND METHODS FOR REDUCING ARTIFACTS CAUSED BY 

ILLUMINANT FLICKER 

BACKGROUND 

5 Image sensors, such as complimentary metal oxide semiconductor (CMOS) 

image sensors, are used to convert patterns of light imaged thereon into electronic 
signals representing images. When converting patterns of light, if the color or 
intensity of an illuminant that provides the light varies with time, undesired artifacts 
may appear in the images. This kind of variation is known as illuminant flicker. 
10 Many illuminants, including AC -powered fluorescent and tungsten lights, 

exhibit illuminant flicker. With these illuminants, the intensity varies periodically, 
i.e., at twice the frequency of the AC power source. With respect to CMOS image 
sensors, illuminant flicker can cause bands of differing image brightness to appear 
across the images that are captured. 

15 

SUMMARY 

Systems and methods for reducing artifacts caused by illuminant flicker are 
provided. One such method comprises: providing pixel circuits; and operating the 
pixel circuits in a bi-directional mode during which first information corresponding to 

20 a scene is acquired in forward row-sequential order of the pixel circuits and then 

second information corresponding to the scene is acquired in reverse row-sequential 
order of the pixel circuits. 

Another method comprises: a method for reducing artifacts caused by 
illuminant flicker; providing pixel circuits; and operating the pixel circuits in a bi- 

25 directional mode during which first information corresponding to a scene is acquired 
in forward row-sequential order of the pixel circuits and then second information 

1 



Agilent Docket No. 10010719-1 

corresponding to the scene is acquired in reverse row-sequential order of the pixel 
circuits. 

A system for reducing artifacts caused by illuminant flicker comprises an 
image sensor comprising an array of pixel circuits arranged in rows, a first of the pixel 
5 circuits being located in a first of the rows, a second of the pixel circuits being located 
in a second of the rows, the first of the pixel circuits being operable to acquire first 
information corresponding to the scene at a first time, the second of the pixel circuits 
being operable to acquire second information corresponding to the scene at a second 
time subsequent to the first time and to acquire third information corresponding to the 

10 scene at a third time subsequent to the second time, the first of the pixel circuits being 
further operable to acquire fourth information corresponding to the scene at a fourth 
time subsequent to the third time. The image sensor is operable to combine the first 
information and the fourth information to provide a first output signal corresponding 
to the first of the pixel circuits, and to combine the second information and the third 

1 5 information to provide a second output signal corresponding to the second of the pixel 
circuits. 

Other systems, methods, features and/or advantages will be or may become 
apparent to one with skill in the art upon examination of the following drawings and 
detailed description. It is intended that all such additional systems, methods, features 
20 and/or advantages be included within this description and be protected by the 
accompanying claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Reference is now made to the following drawings. Note that the components in 
25 the drawings are not necessarily to scale. 
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FIG. 1 is a schematic diagram of an embodiment of a system for reducing 
artifacts caused by illuminant flicker. 

FIG. 2 is a circuit diagram of an embodiment of a pixel circuit that can 
be used in the system of FIG. 1. 
5 FIG. 3 is a flowchart depicting functionality of an embodiment of a system for 

reducing artifacts caused by illuminant flicker. 

FIG. 4 is a schematic diagram depicting operation of an embodiment of a 
system for reducing artifacts caused by illuminant flicker. 

FIG. 5 is a graph depicting intensity versus time for an illuminant 
10 associated with the system of FIG. 4. 

FIG. 6 is a schematic diagram depicting information acquired during the 
operation shown in FIG. 4, in response to the illuminant waveform depicted in FIG. 5. 

FIG. 7 is a graph depicting intensity versus time for another illuminant. 

FIG. 8 is a schematic diagram depicting information acquired during the 
15 operation shown in FIG. 4, in response to the illuminant waveform depicted in FIG. 7. 

FIG. 9 is a graph depicting intensity versus time for another illuminant. 

FIG. 10 is a schematic diagram depicting information acquired during the 
operation shown in FIG. 4, in response to the illuminant waveform depicted in FIG. 9. 

FIG. 1 1 is a schematic diagram depicting another embodiment of a system for 
20 reducing artifacts caused by illuminant flicker. 

FIG. 12 is a flowchart depicting functionality of the system of FIG. 11. 

FIG. 13 is a schematic diagram depicting operation of an embodiment of a . 
system for reducing artifacts caused by illuminant flicker that is operating in a rolling 
shutter mode. 
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DETAILED DESCRIPTION 
As will be described in detail here, systems and methods for reducing artifacts 
caused by illuminant flicker involve the use of image sensors. In particular, 
information corresponding to a scene is acquired by the pixels of such an image 
5 sensor, with the pixels sequentially sampling the scene in forward row-sequential 

order. The scene is then sampled by the pixels in reverse row-sequential order. Thus, 
with respect to each pixel, two samples of information are acquired, i.e., information ' 
acquired during operation in the forward row-sequential order and information 
acquired during operation in the reverse row-sequential order. The two samples of 

10 information for each pixel then are combined to provide an output. Consequently, 
each pixel provides an output that is less affected by illuminant flicker than each of 
the samples of information individually. 

Referring now to the drawings, FIG. 1 is a schematic diagram of an 
embodiment of a system for reducing artifacts caused by illuminant flicker. As shown 

15 in FIG. 1, system 100 includes an array of pixels 102a - 102p, each of which includes 
a pixel circuit. The pixels are oriented in a column-and-row arrangement, with each 
column and each row, respectively, including four of the pixels. A row timing 
generator 104 provides reset and read signals to the pixels. Specifically, each pixel of 
a row of pixels is electrically connected to a reset signal line, which is used to provide 

20 a reset signal to that row of pixels. For example, pixels 102a - 102d of row 1 are 
electrically connected to reset signal line 1 ("RESET 1"). Each pixel of a row of 
pixels also is electrically connected to a read line, which is used to provide a read 
signal to that row of pixels. For example, pixels 102a - 102d are electrically 
connected to read signal line 1 ("READ 1"). Also, all pixels of a column are 
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electrically connected to a column line of that column. For example, pixels 102a, 
102e, 102i and 102m are electrically connected to column line 106. 

System 10 also includes a column timing generator 108 and a column 
multiplexor 110. The column timing generator 108 provides signal for controlling the 
5 timing of the multiplexor 1 10. For example, pixels 102a, 102e, 102i and 102m are 
electrically connected to column multiplexor 1 10 to analog output line 1 via column 
line 106. The column multiplexor 1 10 receives analog output signals from each of the 
columns of pixels and provides a multiplexed analog output to an optional analog-to- 
digital converter (ADC) 112 based on the timing provided by the column timing 

10 generator 108. ADC 1 12 receives the multiplexed analog output and then provides 

digital outputs corresponding to the information acquired by the pixels. Alternatively, 
analog output can be provided. Note that although a 4 x 4 array of pixels is depicted 
in FIG. 1 , various other numbers and arrangements of pixels can be used in other 
embodiments, with the number of pixels typically used being much larger than shown. 

15 In operation, each row of pixels of system 10 is sequentially reset and read, 

and a corresponding analog output from each pixel of a row is provided to the column 
multiplexor 110. The column multiplexor 110 then sequentially selects among the 
analog outputs and provides a multiplexed analog output to the ADC 112. The ADC 
112 then provides a corresponding digital output that can be provided to an image 

20 processor, for example. 

An embodiment of a pixel circuit that can be used in a system for reducing 
artifacts caused by illuminant flicker is depicted in FIG. 2. As shown in FIG. 2, pixel 
circuit 200 is a complimentary metal oxide semiconductor (CMOS) circuit that 
includes three transistors. Specifically, pixel circuit 200 includes a reset transistor 

25 202, a buffer transistor 204 and a row select transistor 206. Such a pixel circuit is 
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generally known as a "3-T pixel circuit." Pixel circuit 200 also includes a photodiode 
208 that is electrically connected between reset transistor 202 and ground 210. 
Reference voltage V dd is electrically coupled to the drain terminals of reset transistor 
202 and buffer transistor 204. The gate of buffer transistor 204 is electrically 
5 connected to the node between the cathode of photodiode 208 and reset transistor 202. 
The source of buffer transistor 204 is electrically connected to the drain of row select 
transistor 206. The source of row select transistor 206 is electrically connected to 
column line 21 1 of the column in which the pixel circuit 200 is located. Row select 
transistor 206 functions as a row select switch. Thus, when multiple pixel circuits are 
10 arranged in an array, such as in the image sensor 100 of FIG. 1, the rows are selected 
by the row select transistors connecting the outputs of their pixels to the respective 
column lines. 

In operation, light incident upon the pixel generates charge in the photodiode 
208. The detection cycle of the pixel circuit does not begin, however, until the pixel 

1 5 circuit has been reset by providing a reset signal to the gate of reset transistor 202. 
Specifically, the reset signal applied to the gate of reset transistor 202 turns the 
transistor ON, which extracts previously-accumulated charge from the photodiode 
208. After reset, the photodiode 208 accumulates charge corresponding to the 
intensity of light incident thereon and the duration of the exposure period. At the end 

20 of the exposure period, the read signal applied to the gate of row select transistor 206 
turns that transistor ON, which electrically couples the photodiode 208 to the column 
line 211, thereby providing, on the column line, an analog output signal corresponding 
to the intensity of the light that was illuminated in photodiode 208 during the exposure 
period. Note that the transistor 204 buffers the output of the photodiode 208 to 

25 prevent the output line from loading the photodiode and attenuating the output signal. 
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Also note that various types of pixel circuits other than the 3-T pixel of FIG. 2 can be 
used in other embodiments of systems for reducing artifacts caused by illuminant 
flicker. 

The row timing generator controls the application of the reset and read signals 
5 to the transistors of the pixel circuits of the pixel array. As will be described in detail 
later, the reset and read signals are applied so that pixels acquire image information 
alternately in a forward row-sequential order of the pixel circuits and a reverse row- 
sequential order of the pixel circuits. With respect to each of the pixel circuits, image 
information acquired during the forward row-sequential order is combined with image 
1 0 information acquired during the reverse row-sequential order to form the image 

information for the pixel circuit in a frame of image data. In some embodiments, a 
control input is provided to the row timing generator for adjusting the timing of the 
reset and read signals. Such an embodiment is described below with respect to FIG. 
11. 

1 5 Having described the structure of an embodiment of a system for reducing 

artifacts caused by illuminant flicker, functionality of that embodiment will be 
described with reference to the flowchart of FIG. 3. As shown in FIG. 3, the 
functionality (or method) may be construed as beginning at block 302, where, an array 
of pixel circuits is provided. In block 304, first image information is acquired using 

20 the pixel circuits operated in a forward row-sequential order of the pixel circuits. By 
way of example, in some embodiments, the first image information is acquired 
sequentially on a row-by-row basis starting from the top row of the pixel circuits. In 
block 306, second image information is acquired using the pixel circuits operated in a 
reverse row-sequential order. Thus, continuing with the previous example, second 

25 image information is acquired from the pixel circuits on the row-by-row basis starting 
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from the bottom row of the pixel circuits. Then, as depicted in block 308, the first 
image information and the second image information are used to produce image data 
with reduced flicker artifacts. Specifically, the first image information and second 
image information are combined, i.e., added, so that flicker artifact, which is 
5 attributed to an illuminant used with the pixel circuits for acquiring the image 
information, is reduced. 

FIG. 4 is a schematic diagram that depicts operation of the embodiment of the 
system for reducing artifacts caused by illuminant flicker depicted in FIG. 1. 
Specifically, FIG. 4 depicts reset and read operations proceeding in a forward 
1 0 direction then in and a reverse direction across the rows of pixel circuits of that 
system. 

As depicted in FIG. 4, during frame element (F. E.) 1 of frame 0, a reset signal 
is provided to the pixel circuits of row 1, i.e., the reset signal is provided at time t=0. 
During frame element 0 of frame 1, which includes times t=l to t=6, each successive 

15 row of pixel circuits is reset and then read. Specifically, at time t=l, the pixel circuits 
of row 2 are reset. At time t=2, pixel circuits of row 3 are reset and pixel circuits of 
row 1 are read. At time t=3, pixel circuits of row 4 are reset and pixel circuits of row 
2 are read. At time t=4, pixel circuits of row 3 are read and, at time t=5, pixel circuits 
of row 4 are read. Note that during the last time interval of frame 1, i.e., t=6, the pixel 

20 circuits of row 4 are reset again. 

Proceeding to the times t=7 to t=12 of frame element 1 of frame 1, the reset 
and subsequent read operations occur in the reverse order of that occurring at times 
t=l to t=5 of frame element 0 of frame 1. Specifically, at time t=7, pixel circuits of 
row 3 are reset. At time t=8, pixel circuits of row 2 are reset and pixel circuits of row 

25 4 are read. At time t=9, pixel circuits of row 1 are reset and pixel circuits of row 3 are 
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read. At time t=10, pixel circuits of row 2 are read and, at time t=l 1, pixel circuits of 
row 1 are read. Then, at time t=12, the pixel circuits of row 1 are reset, with the 
process then repeating the operation at a subsequent t=l of another frame. Thus, the 
reset and read operation advances forwards and reverse across the rows of pixel 
5 circuits in a bi-directional mode. This is in contrast to the conventional way, in which- 
the reset and read operations advance in a uni-directional mode across the rows of 
pixel circuits. In the uni-directional mode, once all of the rows have been reset and 
subsequently read, the reset signal is applied once again to the first row of pixel 
circuits and the process repeats. 

10 In order for the combined image information to exhibit reduced flicker artifact, 

the point of symmetry of the illuminant waveform associated with the illuminant is 
identified. The point of symmetry divides the illuminant waveform into a first portion 
of the waveform that generally exhibits symmetry about an arbitrary illumination level 
with respect to the second portion of the illuminant waveform. The reset and read 

1 5 operations of the pixel circuits are then adjusted so that the first image information is 
acquired from the pixel circuits on the row-by-row basis during a period 
corresponding to the first portion of the illuminant waveform, and the second image 
information is acquired during a period corresponding to the second portion of the 
waveform. 

20 As can be seen in FIG. 4, two samples of information are provided for each 

frame by each of the pixel circuits, i.e., each pixel circuit provides information when 
its corresponding row is read during frame element 0 and then again during frame 
element 1 . For example, each pixel circuit of row 1 provides first image information 
at time t=2 and provides second image information at time t=l 1 . As will be described 

25 in greater detail below, the first image information of a pixel circuit is combined with 
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the second image information of that pixel circuit to provide an output that exhibits 
reduced artifacts caused by illuminant flicker. 

An illumination waveform of an illuminant that exhibits flicker is depicted in 
the graph of FIG. 5. Specifically, the graph depicts the intensity of light provided by 
5 an illuminant plotted against time. As mentioned before, the flicker of the illuminant 
is attributable to the illuminant beiiig powered by an AC source. Note that the graph 
of FIG. 5 also is annotated with the times corresponding to the times of FIG. 4. 
Specifically, two frame elements of the timing sequence are depicted. 

Referring now to FIG. 6, the illumination waveform of FIG. 5 is divided into 

10 portions, one of which corresponds to the acquisition of information by the image 

sensor during frame element 0, and the other of which corresponds to the acquisition 
of information by the image sensor during frame element 1 . Note, the solid-lined 
portion of the waveform indicates time intervals during which image information was 
read from the pixel circuits. The dashed-lined portions of the waveform at the 

1 5 beginning and end of each frame element correspond to those time intervals during 
which no pixel circuits were being read. 

As shown in FIG. 6, by resetting and reading the rows of pixel circuits in the 
bi-directional mode described above, the illumination waveform acquired during 
frame element 1 is temporally reversed compared to the illumination waveform 

20 acquired during frame element 0. Then, by combining the information from the image 
sensor that was captured during frame element 0 with the information captured by the 
image sensor during frame element 1, the effect of flicker can be reduced as depicted 
by the output signal shown at the right side of FIG. 6. 

In FIG. 8, the illumination waveform of FIG. 7 is divided into portions, one of 

25 which corresponds to the acquisition of information by the image sensor during frame 
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element 0, and the other of which corresponds to the acquisition of information by the 
image sensor during frame element 1 . Note, as before, the solid-lined portion of the 
waveform indicates time intervals during which image information was read from the 
pixel circuits, and the dashed-lined portions of each frame correspond to those time 
intervals during which no pixel circuits were being read. 

As shown in FIG. 8, the illumination waveform acquired during frame element 
1 is temporally reversed compared to the illumination waveform acquired during 
frame element 0. Combining the information from the image sensor that was captured 
during frame element 0 with the information captured by the image sensor during 
frame element 1 reduces the effect of flicker as depicted by the output signal shown at 
the right side of FIG. 8. 

In order for the output signal to exhibit reduced artifacts of illuminant flicker, 
such as depicted in FIG. 8, the timing of the reset and read operations of the pixel 
circuits of the image sensor are established to correspond to the waveform of the 
illuminant. Specifically, the timing should be adjusted so that frame element 0 of the 
image sensor corresponds to a first portion of a cycle of the waveform, and frame 
element 1 of the image sensor corresponds to a second portion of the cycle, with 
demarcation of the first and second portions occurring at the location of symmetry of 
the waveform about an arbitrary illumination level. 

As shown in FIG. 9, another example illumination waveform is depicted that 
exhibits symmetry about an arbitrary illumination level. However, as shown in FIG. 
10, the effect of flicker on the output signal has been increased compared to the 
information acquired by the pixel circuits. This is because the timing of the reset and 
read operations of the pixel circuits have not been aligned with the waveform of the 
illuminant as described above. In particular, the timing is not adjusted so that frame 

11 
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element 0 corresponds to a first portion of a cycle of the waveform that is located on 
one side of the location of symmetry, and so that frame element 1 corresponds to a 
second portion of the cycle that is located on the other side of the location of 
symmetry. 

5 The synchronizing of the timing of an image sensor to the frequency of an 

illuminant can be accomplished using knowledge of the characteristics of the 
illuminant waveform. For example, if the illuminant is known to have a flicker period 
of 120 Hz, and the image sensor has 480 rows of pixel circuits, the time interval 
between resetting (and also reading) adjacent rows of the pixel circuits could be set at 

10 17.36 jisec (1/ (flicker frequency * number of rows)) when operating in a uni- 
directional mode. When operating in a bi-directional mode, with an exposure period 
of 2 row periods, the time interval could be set to 17.29 jusec (1 /(flicker frequency * 
(number of rows + exposure period in number of rows)). Note that the reset and read 
operation should also be aligned with the illuminant waveform as described 

1 5 previously. 

In some embodiments, however, synchronizing of the timing of an image 
sensor to the waveform of an illuminant can be accomplished dynamically. In this 
regard, an example of another embodiment of a system for reducing artifacts caused 
by illuminant flicker will now be described. 

20 As shown in FIG. 1 1 , system 400 includes an image sensor 402 that 

incorporates an array of pixel circuits (not shown). The image sensor acquires image 
information corresponding to a scene and provides image data as an output. The 
image sensor provides the image data to an image processor 404, which combines the 
acquired information in accordance with a designated technique, such as the bi- 

25 directional mode described above. For instance, when operating in the bi-directional 
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mode, the image processor receives first information and second information 
corresponding to each of the pixel circuits of the image sensor and combines the first 
and second information to produce image output data. 

The image processor 404 provides the image output data, which can be used to 
5 drive a display device or can be stored in a memory storage device, for example. The 
image processor 404 also provides a feedback output to a flicker detector 406, which 
analyzes the feedback output to determine the existence and/or degree of flicker 
artifact in the feedback output. The flicker detector 406 can use a technique such as 
Fourier analysis to detect the magnitude of the signal at the flicker frequency. By 
10 comparing samples of the feedback output, a determination can be made as to whether 
flicker artifact has been minimized. Note, the feedback output may be identical to the 
image output data. 

The flicker detector 406 then provides artifact data to a controller 408, with the 
artifact data being indicative of whether the flicker is increasing or decreasing: The 

15 controller 408 provides a control input to the image sensor 402, e.g., to the row-timing 
generator, for controlling the timing of various operations, such as timing of reset and 
read operations. Typically, the controller adjusts the operation of the image sensor 
using the control input until the flicker is minimized. This can include increasing 
and/or decreasing the time interval between resets, increasing and/or decreasing the 

20 time interval between reads, and adjusting the onset of the reset and read process with 
respect to the illuminant waveform. Note, each of the image processor 404, the flicker 
detector 406 and the controller 408 can be implemented in hardware, software or 
combinations thereof. 

Additionally or alternatively, embodiments of controllers can change the 

25 modes of operation of associated image sensors. In particular, some controllers can 
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enable associated image sensors to operate selectively in bi-directional modes, in 
which the reset and read operations sweep back and forth across the rows of pixel 
circuits, and in uni-directional modes, in which the reset and read operations sweep 
only in one direction across the rows of pixel circuits. Note that use of the uni- 
5 directional mode may be preferred if the illuminant waveform does not exhibit 

symmetry about an arbitrary illumination level, since use of the bi-directional mode 
may exhibit a negligible reduction in flicker or, in some cases, may increase its 
effects. Functionality of an embodiment of a system for reducing artifacts caused by 
illuminant flicker that can selectively operate in each of a bi-directional mode and a 

10 uni-directional mode will now be described with reference to the flowchart of FIG. 12. 
As shown in FIG. 12, the functionality (or method) may be construed as 
beginning at block 502, where an image sensor that is selectively operable in each of a 
bi-directional mode and a uni-directional mode is provided. In block 504, a 
determination is made as to whether the image sensor is to operate in a bi-directional 

1 5 mode or a uni-directional mode. If it is determined in block 504 that the image sensor 
is to operate in the bi-directional mode, the process proceeds to block 506 where the 
image sensor is operated in a the bi-directional mode. Note, this may include aligning 
a detection cycle of the image sensor with an illumination cycle of a corresponding 
illuminant, as previously described, in order to ensure that flicker is minimized. 

20 When, however, it is determined that the image sensor is not to operate in the bi- 
directional mode, the process proceeds to block 508, where the image sensor is 
operated in the uni-directional mode. The uni-directional mode of operation will now 
be described with respect to FIG. 13. 

FIG. 13 is a schematic diagram that depicts operation of an embodiment of a 

25 system for reducing artifacts caused by illuminant flicker that is operating in a uni- 
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directional mode. Note that, similar to the description accompanying FIG. 4, the 
image sensor is assumed to include only four rows of pixel circuits for ease of 
description. 

As depicted in FIG. 13, each successive row of pixel circuits is reset and then 
read during frame 1, which includes times t=0 to t=5. Specifically, at time t=0, the 
pixel circuits of row 1 are reset. At time t=l, the pixel circuits of row 2 are reset. At 
time t=2, pixel circuits of row 3 are reset and pixel circuits of row 1 are read. At time 
t=3, pixel circuits of row 4 are reset and pixel circuits of row 2 are read. At time t=4, 
pixel circuits of row 3 are read and, at time t=5, pixel circuits of row 4 are read. 

The above-described process repeats every frame, beginning with reset of the 
pixel circuits of row 1 and ending with read of the pixel circuits of row 4. Thus, the 
reset and read operations advance in one direction among the rows of pixel circuits. 

It should be emphasized that many variations and modifications may be made 
to the above-described embodiments. For example, the functionality associated with 
the blocks of one or more of the flowcharts of this disclosure may occur out of the 
order in which depicted. All such modifications and variations are intended to be 
included herein within the scope of this disclosure and protected by the following 
claims. 
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